The MUTE silent speech recognition system

نویسندگان

  • Geoffrey S. Meltzner
  • James T. Heaton
  • Yunbin Deng
چکیده

sEMG based silent speech recognition has become a desirable communication modality because it has the potential to provide natural, covert, hands-free communication in acoustically challenging environments. To enable this capability, we have developed a portable, self-contained, Android based Mouthed-speech Understanding and Transcription Engine (MUTE) system. To demonstrate the MUTE system’s ability to recognize a continuous vocabulary of 210 words we propose to conduct map task based demonstration, in which a MUTE user guides a “listener” around a schematized map. The listener draws out a map based on the received instructions; a comparison of the original and drawn map then illustrates the MUTE system’s recognition performance.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Two- and three-dimensional visual articulatory models for pronunciation training and for treatment of speech disorders

Background: Visual articulatory models can be used for visualizing vocal tract articulatory speech movements. This information may be helpful in pronunciation training or in therapy of speech disorders. Method: For testing this hypothesis, speech recognition rates were quantified for mute animations of vocalic and consonantal speech movements generated by a 2D and a 3D visual articulatory model...

متن کامل

Detecting Silent Vocalizations in a Locked-In Subject

Problem Addressed. Decoding of silent vocalization would be enhanced by detecting vocalization onset. This is necessary in order to improve decoding of neural firings and thus synthesize near conversational speech in locked-in subjects implanted with brain computer interfacing devices. Methodology. Cortical recordings were obtained during attempts at inner speech in a mute and paralyzed subject...

متن کامل

Silent at school--elective mutism and abuse.

A retrospective case-control study of electively mute children from one city is reported. Eight of 18 children selectively mute in school had suffered definite or probable abuse compared with only one control with a speech or language problem, and no classroom controls. The implications for management are discussed.

متن کامل

A Spectral Mapping Method for EMG-based Recognition of Silent Speech

This paper reports on our latest study on speech recognition based on surface electromyography (EMG). This technology allows for Silent Speech Interfaces since EMG captures the electrical potentials of the human articulatory muscles rather than the acoustic speech signal. Therefore, our technology enables speech recognition to be applied to silently mouthed speech. Earlier experiments indicate ...

متن کامل

A Multimodal Framework for the Communication of the Disabled

In this paper, a novel system, which aims to provide alternative tools and interfaces to blind and deaf-and-mute people and enable their communication and interaction with the computer is presented. All the involved technologies are integrated into a treasure hunting game application that is jointly played by the blind and deaf-and-mute user. The integration of the multimodal interfaces into a ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013